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1 Introduction 



The structure of the equihbrium states of mean field spin glasses has been widely 
discussed in the literature At low temperature ergodicity is broken, and the 
contribution to the Boltzmann average comes from "valleys" separated by infinite 
barriers. The statistics of the correlations between the different valleys for equal 
values of the external parameters, is one of the most remarkable outcomes of the 
replica method. In the context of the Parisi ansatz, it is found that the function 
q{x) is directly related to the statistics of couples of valleys, while the whole set 
of states is organized as an ultrametric tree. Much less information is available 
about the relations among the equilibrium states for different values of the external 
parameters. The object of this paper is an investigation of this relation. 

The states of mean field spin glasses can be thought as low free energy solution 
of TAP equations. Changings in the external parameters can cause the appearance 
or the disappearance of solutions and modify the relative order of the free energy 
levels. There are models, for example the p-spin spherical spin glass, where the order 
of the levels is not affected by changes in temperature 0. In this case the states 
at different temperatures are correlated. In a model where a change of an external 
parameter imply a reshuffling of the states of an extensive amount, we expect to 
find zero correlations between states at different values of the external parameters. 

The problem of the correlations between low free energy states at different values 
of the external parameters has been addressed for the SK model by Kondor and 
Kondor and Vegso |Q. Within the frame of the replica method they considered 
the partition function of two realizations of the same system for different external 
parameters. In these papers there were assumed constant correlations; this constant 
was found to be zero in mean field and the Gaussian corrections to this situation 
were computed. 

Here we reexamine the question without using this assumption. Instead we fol- 
low a method introduced in ||^, and we take into account in the partition function 
(Z) of the two systems only these couples of configurations having overlap equal to 
a fixed value pd- It was shown in [Q, in the case of two systems at equal external pa- 
rameters, that if Pd is in the support of the probability function P{q), the logarithm 
of the constrained partition function is extensively equal to that of an unconstrained 
system. This result tells simply that the partition function is dominated by these 
couple of equilibrium states which satisfy the constraint. Conversely, if pd is out of 
the support of the P{q) the system is forced out of equilibrium and this implies an 
extensive increase of the free energy F = —\ogZ. 

In the present case, an extensive increase of F implies a reshuffiings of the free 
energy level of an extensive amount, and zero correlation between states for different 
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external parameters. The method, relying on the saddle point approximation, is 
limited to the computation of the extensive part of the free energy. So, a zero cost 
in free energy density would not strictly imply no reshuffling, but just that the 
reshuffling is not extensive. We will refer to "chaos" with respect to an external 
parameter to a situation in which the free energy increase is extensive. 

The paper is organized as follows: In section 2 we state the basic definitions and 
our method. In section 3 we discuss the problem in the simple case of the Derrida 
Generalized Random Energy Model (GREM), where handwaving arguments show 
that there is no chaos with temperature in absence of a magnetic field, and along the 
lines of constant magnetization. We show how some modifications in those models 
produce chaos with temperature. In section 4 we study the SK model near the 
glassy transition. We show that no ultrametric solution exist for the problems with 
different magnetic fields or temperatures. We argue that this is the sign that chaos 
is present in both cases and give estimation for the free energy increase. Finally we 
draw our conclusions in section 5. 



2 The model 

Let us consider a system composed of two copies of a Sherrington Kirkpatrick (SK) 
model, having different temperatures and magnetic fields, {Ti,hi) and (T2,/i2) re- 
spectively. The partition function of such a system is 



J2 ^^P 
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Where the couplings Jij = 1, ■.■,N) are Gaussian independent variables of zero 
mean and variance 1/N, and the spins S'[ are Ising variables. In the following we 
will improperly call free energy the quantity F = — log Z. To address the question 
of the correlations between the states dominating Zi, and Z2 respectively, let us 
consider Z{pd) the sum (|lD restricted to these configurations which verify 



Pd 



N 



(2) 



It is clear from the definition that Z{pa) < Z. It is shown in in the case 
Ti = T2 and hi = h2 that, in the low temperature phase, one has (l/A^)logZ = 
(1/A^) \ogZ{pd) as soon as pd is in the support of the function P{q) of the free sys- 
tem. This is a consequence of the fact that the number of valleys dominating the 
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partition function grows less then exponentially with N, as it can be easily under- 
stood noting that Z = J dpdZ{pd). An increase in free energy at an extensive level, 
implies the absence of low-lying states having overlap pd- 

In it was shown how to deal with a problem of two coupled copies with 
the replica method. We shall not repeat here the derivation of formulae which is 
completely analogous to that ref.|^, but we shall just sketch the results. Instead of 
the usual order parameter matrix Qab of the replica method, there are 3 matrices 
Qab J Q^ab ^^'^ ^ab representing respectively 

Q^ = J,T.SrS^^ r = l,2 Pab = ^Y.Srsf. (3) 

i=i i=i 

where a, 6 = 1, n and n is "the number of replicas", which as usual has to be sent 
to zero. The constraint in the partition function implies that the elements Paa have 
to be set equal to pd- Combining Q*^^-*, Q^'^\ P and its transposed P^ into the matrix 

Q ^ ^ ^„ j. and denofng its elements as Q.,. a ^ (na). ^ ^ (...) it 

is possible to see that for both Ti and T2 near the critical temperature Tc = 1 and 
hi and h2 small, Qq,/3 ~ 1 — Ti and the free energy admits the expansion up to the 
fourth order in — Tc (s = 1, 2): 

F{Pd) = - lim 4logZ(pd) 

W— >oo iV 

= - hm ^ (riTrg(i)' + t.TtQ^'^' + 2n,TTP' + ^TtQ' 
n^o 2n { 3 



g -^ap ■ ^ w 2 ^-^ ~*«P '^Pl 

a/3 0/37 

ab ab ab ) 



(4) 



where 



r, = (1-T2)/2 s=1,2 ri2 = (l-TiT2)/2. (5) 



For the "complete" SK model y = u = v = w = l. It is costumary in the study 
of the glassy transition to consider a "truncated", (or "reduced") model in which 
it is arificially posed y = v = 0, and retained only the term J2ai3 Qa/3 among all 
the quartic terms. Kondor and Vegso have shown recently that this can give rise 
to instabilities in considering couples of systems with different temperatures when 
the magnetic field is zero. We anticipate that the argument showing the presence 
of chaos do not depend critically on which of the two models is used. So, we will 
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use the complete model to prove the presence of chaos and we will estimate the free 
energy increase within the truncated one. In any case (^) has to be maximized with 
respect to the values of the elements of the replica matrices. 

The basic object of our investigation will be the free energy difference 

AF = F{pd) - F (6) 

where F is the logarithm of the partition function of the two systems (at two different 
external parameters) without constraint, and is equal to the sum of the free energies 
of the two systems. In the following we will refer to AF as "free energy excess", 
and to "chaos" whenever this quantity is non zero. 

Following we will consider here an analytic continuation to n — > for F{pd) 
in which each of the matrices Q^^^ and P are parametrized according to the Parisi 
scheme, that is, specifying the value of the diagonal elements and a function of the 
interval [0,1]. 

gW^(0,g,(x)); P^(prf,p(x)) 0<x<l. (7) 

The usual restriction of the choice of the Parisi function to the space of non decreas- 
ing function, is here substituted by the requierement of semi-positive definiteness of 
the matrices 

\ P'{x) q',{x) ) 

for any x, where the primes denote derivation with respect to x In particular, 
this implies that the functions ^^(x) are both positive. 

The saddle point equations of maximization of F2{pd) of the truncated model 
are written in terms of the qs{x) and p{x) as 

SF Z"^' 

2[t-s - {qs)]qs{x) + 2[pd - {p)]p{x) - / dy[qs{x) - qs{y)f 



dqs{x) Jo 



- r dy[pix) -p{y)f + Iq^x) + h] = 0, (9) 

Jo 6 



5F 

[ri2 - {qi + q2)]p{x) + [pd - {p)][qi{x) + g2(x)] 



6p{x 



X 2 
dy[qi{x) -qi{y) + q2{x) - q2{y)][p{x) - p{y)] + -p'^ix) + hihi = 0, (10) 



We also write for further reference the expression for the derivative of F with respect 
to Pd. 

dF 2 

^ = -[Ti2Pd - {p{qi + q2)) + ^pI + hih2] (11) 
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Our variational equations differ from tlie one considered in reference Q in tlie 
fact tliat tliere pd was taken as a variational parameter and the function p{x) was 
constrained to a constant. We will see in the next section that models without chaos 
require non constant p{x). 

Before starting the discussion of the maximization of and the solutions of 
(PIPI?D, we discuss the correlations between states at different temperature and mag- 
netic field in the GREM. 



3 The GREM: a model without chaos. 

Let us briefly review the Derrida construction of the Generalized Random Energy 
Model. Without any pretension of being exhaustive on this point, we refer the reader 
to the original papers on the model 0, ||, ||]. 

In the GREM one considers 2^ configurations, associated to the "leaves" of an 
ultrametric tree. The tree, is composed of L levels of branching. At a level a, each 
branch generates Afa = exp(NSa) new branches, in such a way that 2^ = e^^^'^". 
To each branch at a level a is associated a random energy so that the total energy 
of a configuration is given by = J2a The are taken as independent Gaussian 
variables of zero mean and variance = NJ^/2. Two configurations are conven- 
tionally said to have an overlap Qa, with < < 1, if they coincide at a level a, 
and consequently have the same ep for j3 < a. It can be eventually considered a 
"continuum limit" of infinite number of levels (L —>■ oo) with infinitesimal spacings, 
where Ja — >■ J{q)dq Sa —>■ S{q)dq . This exhausts the construction in absence of a 
magnetic field. In presence of a magnetic field h one has to associate magnetization 
one to an arbitrarily selected state, in such a way that the configurations of magne- 
tization m are those having an overlap equal to m with this state. For these states 
the energy gets an extra contribution equal to —Nhm where h is the magnetic field. 

In the following we will limit our discussion to the case where J{q) and S{q) 
increase with g, where the levels associated with small q freeze at higher temperature 
than the levels of high q. 

The absence of chaos with temperature in zero magnetic field is almost obvious; 
a change in temperature do not affect, by definition of the model, the order of the 
energy levels. So, two equilibrium states at different temperatures T and T' can 
be strongly correlated. In the same way it is easy to realize that there is chaos 
with the magnetic field. Two different magnetic fields, say hi and /i2; impose to the 
system to have magnetization respectively mi and m2 with mi ^ 1712. By construc- 
tion the overlap between two states with such different magnetizations is equal to 
qi2 = min{mi,m2}. Imposing a different overlap would bring the magnetizations 



6 



out of their equilibrium values, implying an extensive cost in terms of free energy. 
Furthermore, in presence of a magnetic field, a change in temperature implies a 
change in the magnetization, and again we find chaos. Thus chaos is clearly absent 
along the lines (T, h) of constant magnetization |]10 . 



Let us now show with the aid of the replica method that, for two different 
temperatures in zero magnetic field, it is cost-less to impose an overlap pd in the 
support of the P(q) function. Note that the same results could be easily obtained 
with the Derrida probabilistic technique. The replicated partition function of the 
GREM in zero field, in the discrete formalism is 



E 



exp 



E f^sejs. 



'121 



where the level ao corresponds to the overlap pd, a = I, L, s = 1,2 and a = 
1, . . . , is the indice of replica. Upon performing the average over the values of the 
energy levels one gets 



E exp 

{jS.s} ^ 



N 

T 



E 



ab 



n ^: 



q:<q:q 



(13) 



To evaluate the partition function we make the following ansatz on the arrangement 
of the replicas. We suppose that for the levels a < «o, where j"i = j"2, the replicas 
are divided into n/xa groups of Xa coinciding states (i.e. j^,, = j^^ for any r, s if a 
and b are in the same group). For the levels a > ao, one has j"^ 7^ j°2) one 
can divide, accordingly to the same scheme the replicas with s = 1 and s = 2 into 
n/xl^ and n/x"^ groups respectively. It is easy to see that the free energy is given by 
the expression 



^ logZ" 



nN 



= E 

a<aQ 

+ E 

o>oo 



S.{^ + \) + j'Mxl + f3lxl) 



-1+2 



(14) 



taken at the saddle point aver the various x. Assuming that the level ao is frozen at 
the temperatures T\ and T2 one finds upon deriving with respect to Xa, x\ and x\ 



(/?l+/52)'xf 

X' 



s 2 
s "^a 

J = 1 



jT a<ao 

a> ao and Sa/{Jll3l) < 1 
a> ao and Sa/{JaPs) > 1 



(15) 
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Substituting in (|I|) one sees easily that (1/A^) logZ" = (l/A^)[logZf + logZJ], that 
is, we find no chaos with temperature. 

It is interesting to notice that, in the continuum hmit, inverting the functions 
x{q) and Xs{q), the functions qs{x) and p{x) take the form: 

f quiiPi + p2)x) X <Xo 
Qsix) = I Pd Xo<x<Xs (16) 

[ Quif^sX) x> Xs 

= I + P-2)X) X<Xo 

\ Pd Xo<X 

where qu{l3x) is the inverse function of I3x{q) = S{q) / .P{q), and the points Xq and 
Xs are defined by the relations 

g«((/?i + l32)xo) = quiPsXs) = Pd- (18) 

The only solution with a constant p{x) is the one with pd = p{x) = 0. 

So we have shown that, in a situation where the order of the levels do not depend 
on the temperature, imposing an overlap pd in a suitable interval do not imply an 
extensive free energy cost i.e. there is not chaos with temperature. The situation 
is different if the ordering of the state depends on the temperature. In the context 
of the GREM model, such a dependence can be introduced upon considering one or 
two of the following modifications : 

• choosing temperature dependent Sa or Jq, 

• not imposing the identity of the levels for different temperatures. 

Here we choose to discuss the simplest possible case, namely the second point. We 
take a REM, (i.e. a GREM with only one level, L = 1) where the Gaussian energies 
depend on T, and the correlations are specified by 



e,(ri)efc(T2) = 5,,fe-C(ri,T2)iV (19) 

where C{Ti,T2) < = C{T,T). Let us compute within the replica formalism, 
the partition function of 2 replicas, at temperatures Ti and T2 below the freezing 
transition, constrained to be in the same state 



ja 

= 5:exp|iV[(/52 + /52)j2 + 2A/52C^(ri,r2)|^5,.,..J (20) 



ab 
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Proceeding as above for the GREM (dividing the rephcas into groups) one finds that 

:^logZ^= v/log2((/32 + J2 + 2P,P2C{T,, T^)) < -L log Zf + log^. 

(21) 

The equahty is recovered for C(Ti,T2) = which corresponds to identical levels 
at the two temperatures. It would be interesting to understand if this mechanism 
which produce chaos with temperature is of any relevance in microscopic models. 



4 Chaos in the SK model. 

Let us now turn to the study of the SK model and investigate the possibility of ab- 
sence of chaos. A possible scenario implying the absence of chaos has been proposed 
in The states at different temperatures are strongly correlated. Lowering the 
temperature the ultrametric tree of states undergoes multifuractions in such a way 
that the states at the new temperature are the descendent in the tree of the ones 
at the old temperature. This is what happens in the GREM, and it seems reason- 
able that whenever chaos is absent this must be the correct picture: the states at 
different temperatures must be part of the same ultrametric tree. In this case the 
total matrix Qq,^ should be ultrametric: for any given three distinct replicas a,/?, 7 
one should find Qq,/3 > minjQo,^, Q/?^}. Specializing the relation to a = (l,a), 
/3 = (2, a), 7 = (1, c) , that is, Qia,2a = Paa = Vd it is easily found that 

n — TD _ ) Pd Qla,lc > Pd /^,o^ 

Vlc,2a — ^ac — S ^ p. [^^) 

[ Vla,lc Vla.lc < Pd 

If we suppose that, as in the case of coinciding external parameters, the functions 
qs{x) and p{x) are continuous 0, we find that the condition ( ^2] ) refiects on the 



functions qs{x) aiidp{x) in the following way: qi{x) and q2{x) must be non decreasing 
in the whole interval [0, 1], and it must exist a point x in [0,1] such that 

qs{x) = p{x) = q<{x) X <x 

p{x) = Pd X > X (23) 

By continuity one has g<(x) = pd- 



The solution (|16|,|T^ for the GREM is obviously of the form proposed here. A 
solution of this form was found in in the case with Ti = T2 = T and /ii = /12 = h. 
It reads 

0<x< xo/2 

= q2{x) = { Pd xo/2 <x<xo (24) 

xq < X < 1. 
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iqA2x) 0^x<Xo/2 
[ Pd Xo/2 < X < 1. 

Where the function qpix) is the "free" Parisi function 

{Qmin (~4~) ^ X ^ Xmin 

2 Xjjiin ^ X X^nax (^6) 
l-Vl-4r < T < 1 

Hmax 2 •'^max ^ ^ 

where xq is the point defined by qpixo) = pd and Xmin and x^ax are given by 
continuity. The interval of pd for which this solution is well defined, and that will 



be considered in the following, is Qmin ^ Pd ^ Qmax- The form (|2^ , |25|) is not limited 
to this problem; just as a consequence of ultrametricity any model with replica 
symmetry breaking admits as solution of the two replicas problem if the 



function qpix) solves the single replica one [0. 

The main result of this paper is that as long as Ti 7^ T2 or hi 7^ /i2 it does 
not exist an ultrametric solution of the kind ( pSj) both for the truncated and the 
complete models of section 2. A prove of this fact can be given assuming a form of 
the kind (|23|) and showing that it does not satisfy the saddle point equations. We 
postpone this prove to the appendix; despite its conceptual simplicity the prove, 
already rather technical for the reduced model, is complicated by the necessity of 
using the complete model if we want a full control of all the terms of order in the 
free energy. 

We conclude that chaos must be present both in temperature and magnetic field. 

We shall now give some estimate for the free energy excess to impose the con- 
straint (j^) in various situations. The solution of equations (P|,PDD for generic values 
of the temperatures, the magnetic fields and pd is very difficult to find. We have seen 
that the situation simplifies for hi = h2 and Ti = T2 where the solution for generic 



Pd is ( |2^p5| , |26| ) . Other simple cases, to be presented below, are found for Ti ^ T2 
and hi 7^ /i2 for special values of pd = Pd which allow for functions p{x) constant 
with X. It is easy to find that in this last case the system verifies dF/dpd = 0, that 
is, the free energy is an extremum with respect to pd- The only stable solution is the 
one which is a minimum with respect to pd 0] , and has a free energy excess equal 
to zero0. It is easy to find that this solution must verify: 

qs{x) = qpix) and p{x) = pd- (27) 



^The reader should not be confused at this point; we are by no means extremizing F with 
respect to pd, but we are claiming that it exists a special value p^^ for which the free energy has a 
stable saddle point with p{x) — constant. 
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The values of pd for which this solution exists satisfy 



TuPd- {qi + q2)pd + yPd + hih2 = o (28) 

which coincides with dF/dpd = (see (|TT|) ). This solution was first found by Kondor 
in . It is the only solution we found which has zero free energy excess and it implies 
minimal correlations among states corresponding to different parameters. 

We shall use both the solutions ( P^J25| ) and ( P7| , pBD as starting points to compute 



the free energy excess perturbatively in some small parameter. We shall consider 
the three following limit situations: 

• case (1) Ti = T2, hi 7^ Pd = Pd + ^Pd and we perturb for small 5pd around 
the solution of (p!0D with p{x) = p% 

• case (2) Ti = T2, h2 = hi + 6h fixed pd and we perturb for small Sh around 
the solution (^3,551). 



• case (3) Ti 7^ T2, hi = h2, Pd = Pd~^ ^Pd and we solve perturbatively in Spd- 

In all cases instead of solving the equations (p|,p!OD even in an approximated form, 
we will suitably parameterize the functions qs{x) and p{x), and maximize the free 
energy functional with respect to these parameters. This variational procedure will 
enable us to obtain lower bounds for the free energy excess in the various situations. 
We expect however to obtain the correct order of magnitude of AF as a function 
of the various external parameters. The whole program is analogous to the one 
pursued in to compute the free energy excess to have pd out of the support of 
the P{q) for identical parameters or in to study violations of ultrametricity. We 
refer the interested reader to these papers for a presentation more detailed than the 
present one. 

Let us illustrate as an example the case (1). For Pd = Pd + ^Pd {^Pd « Pd) we 
look for functions qs{x) and p{x) equal to (pT]) plus some small variations. These 
variations, that we call Sqs{x) and Sp{x), have to be of order of 6pd in the saddle 
point solution. We choose to parameterize them as follows 



Sqi{x) 




X ^ XiYi/2, 



J2 < X < xi + 6x1 Sq2{x) 



X > Xi + 6x1 

SP{X) = I 1^2 



X < X 
X ^ 




tX Xj I 

Xm/2 < X < X2 + 5X2 
X > X2 + 5X2 



(29) 
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Figure 1: The free energy excess AF/Sp"^ as a function of q. 
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curve (b): g^^^ = hi = AF = for q"^-^ = 0. The symmetry of AF as a function 
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where a;m/2 is arbitrarily choosen as the middle of the first plateau in qp, i.e. 
Xm = min[a;i,X2] with Xg = '^qfriin = (3/i^/4)^/^, {s = 1,2). The vari- 

ous parameters appearing above are determined by maximization of the free energy 
functional supposing self-consistently that they are of order 5pd- It turns out that at 
the lowest order the free energy excess is of order As we are only interested to 
the lowest order we can minimize the polynomial of order two obtained expanding 
up to second order the free energy functional in all the parameter of order The 
resulting saddle point equations are linear equations in the (10) variational param- 
eters, that we solved numerically for given values of r, hi and h2- In figure 1 we 
present the result for the free energy excess at some values of the external parame- 
ters. We also solved analytically the equations in the two limit cases (1) /i2 = and 
(2) h2 = hi + 6h with 6h « hi. In this last case we just computed AF to the first 
order in 6h. The results for these two cases are: 

/\F = i i^W) ^Pd ^1^^ / Qmax h2 = 

I -^6pl hi 6h 6h « hi 

In all cases the variational parameters turned out to be consistent with the 
hypothesis of being of order 6pd and with the positivity condition (H), e.g. in the 
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case h2 = 0, /ii 7^ 0, Xm = 0, we found 6ql = -Spaq-min/ mmax - Mmin) and 
5p^ = 5p^ = Spd the other variables being zero. 

The computation of case (2) for small field difference Sh = h2 — hi follows a 
very similar scheme. In this case we perturb around the solution of the problem 



with 6h = (p^p5[) with Qmin ^ Pd ^ Qmax- Without entering in the details of the 
solution, which is similar to the one of the previous case, we just give the result. 
Under the (self-consistent) hypothesis that all the variations are of order 5h one 
finds that the free energy excess is of order dh?. We get 

AF = \5h^{p, - + g_)M±^Ml!l!^±^ (31) 



note that, as it should be, the free energy excess is zero for pd = 

Very similar paths can be followed to study the case (3) of chaos with tempera- 
ture. We found here for the free-energy excess 

AF = (32) 

It is worth noticing that eq. ( p2D is derived from the truncated model in a magnetic 
field hi = h2 = h but does not depend on h. As it was noticed by Kondor and Vegso 
[§] the truncated model presents a spurious instability in the fluctuation matrix. The 
result (B^) shows that our calculation is insensitive to this instability. 



Formulae ( p0iplip2D can be used to estimate the probability distribution for an 



overlap pd among states at different parameters in finite systems via the relation 



'^{pd) ~ exp [—N AF). This relation allow for tests of (0,^,^) in numerical 
simulations. 

Finite dimensions 

Let us now briefly comment about the relevance of our results for finite dimen- 
sional spin glasses. 

In addition to the spin-spin correlations an important quantity in finite dimension 
is the correlation overlap function < SiSj >i< SiSj >2- In a chaotic situation this 
decays exponentially with a characteristic length ^12 for large |« — j|. This quantity 
was studied in p, |[ where it was found that, when d > 8 

^o,h ~ /i^'/' and eTi,T2 ~ \Ti~T2\'\ (33) 



This behaviour was confirmed in numerical simulations by Ritort |T^. The sensi- 
tivity to small variations of an external parameter X is characterized by a "chaos 
exponent" in ^Xi.X2 ~ l^i ~ -^2!"^'^^; fii'st considered in the framework of the 



scaling theory of Bray and Moore |jTj] and the droplet theory of Fisher and Huse 
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These results (^) may be compared with ours via the relation found in |T^ 

NMU ~ (34) 

where [■ ■ ■]av denotes the average with respect to the distribution function of p^, 
V{j)d) ~ exp (— AF). Upon substituting our results for the free energy excess 
AF one recovers the results ( p3D for the dimension independent exponent C, in the 
corresponding cases, in the case of two non-zero magnetic fields, for small — /i2| = 
5h our result is: 

ih,M+sh ~ {h^5h)-^'\ (35) 
In lower dimensions it is possible to determine ^ri,T2 [0? [H; [16| and AF 



within the scaling theories. The differences with mean-field are that the relation 
between the two is different from (|3^ that gives AF ~ 5p\\Ti — T2\'^^'^., the exponent 
C now depends on dimension and there are two regimes in temperature with two 
different behaviours of the two quantities mentioned [0 (one is the low-temperature 
phase, the other is the critical region). It could be interesting to see whether the 
latter happens in mean-field too. 



5 Conclusions 

We have studied in this paper the correlations among states at different magnetic 
fields and temperatures in some spin glass models. In the REM and in the GREM 
it is absent chaos with temperature, while there is chaos with magnetic field. This 
is understood in simple terms based on the ultrametric construction of temperature 
independent trees. As soon as a temperature dependence is assumed, considering 
correlated but not identical energy levels for different temperatures, chaos is present. 
This could provide a possible mechanism for chaos production in microscopic models. 

In the SK model near we find that a free energy excess has to be paid to 
constrain two systems to have an overlap greater than the one corresponding to 
zero correlations, if the magnetic fields or the temperatures in the two systems are 
different. This implies that all the possible couples of states with different external 
parameters and free energy density equal to the one of the states dominating the 
partition function, have minimal correlations. The scenario we find has implication 
on the physical picture of the low temperature phase of the model. The hypothesis 
of successive bifurcations of the ultrametric tree as the temperature is lowered [|ri|] 
is incompatible with our results. 

Let us conclude commenting on the fact that temperature cycling experiments 
in spin glass off-equilibrium relaxation [|l^ show strong correlations in the dynamics 
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at different temperatures on finite time scales. If the physics of experimental spin 
glasses were similar to that of the SK model in this respect, one could expect these 
correlations eventually to decay to zero for large times. It would be very interest- 
ing in this context to test the finite time behavior of the SK model in simulated 
temperature cycling experiments. 
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Appendix 

In this appendix we show that no ultrametric solution of the kind discussed in section 
2 exists for the SK model near Tc @. We will show this by absurd, assuming an 
ultrametric solution with qs{x) and p{x) continuous in x. The discussion is done 
in the case of the complete model, the same argument could also be applied to the 
truncated model, with the same conclusions. 

We discuss the case hi = h2 = and different temperatures, a similar (and 
simpler) prove leads to the conclusion that there is chaos with magnetic field. Let 
us write the variational equations for the complete model considering generic values 
of w, u, y, v: 

2TrsQaP + w{QXp + ^uQlf, ' vJ^lQl^ + Q}^]QaP + v{Q%p = 0. (36) 

Plugging in the Parisi form for the matrices Qs and P one get a set of coupled 
integral equations for the functions qs{x) and p{x) that can be solved by repeated 
differentiation with respect to x. 



For future reference we write the solution of the free case [19] at a temperature 
r = (1 -r2)/2. 

X <x 



Qf{x) 



2u ^/I^ ^ ^37) 
g(l) X > X 

Where q{x) is continuous in x and g(l) is specified by the equation 

2r + 2y{q^) - 2wq{l) + {3v + 2u)q{lf = 0. (38) 

In order to solve the problem we have to compute the Parisi functions associ- 
ated to the various terms of (|36|) . In particular we need to compute the functions 
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associated to 

^ " PiQi + Q2) Ql + P' I ^^^^ 

and 

3_/ Q\ + P\'2Qi + Q2) P'' + P{Ql + Ql + QiQ2)\ ...^ 
\P^ + P{Q\ + Ql + QiQ2) Q^ + p2(Qi + 2Q2) )' ^ ^ 

To do that let us remind that the eigenvalues associated to a Parisi matrix A —>■ 
{ttd, a{x)) are: 

^0 = cid ~ {O') with multiplicity 1 (41) 
X{x) = ad — xa{x) — dy a{y) with multiplicity — n—. (42) 

J X X 

Observing that 

X'{x) = —xa{x) (43) 



one can invert the relation (42) and get 

X'(v) 

a(x) = a(l) + / dy (44) 
Jx y 

Let us denote \i{x) , \2{x) , \p{x) the eigenvalues associated with Qi,Q2,P respec- 
tively. The eigenvalues associated to will be: 

Q2 + p2^X',{x)+\l{x)='Ux) (45) 
P{Qi + Q2) ^ X,{x)[X,{x) + X2{x)] = ^Ap{x) (46) 

(s = 1, 2) the corresponding functions can be obtained from (|^) noting that as the 
magnetic field is zero gs(0) = p{0) = 0, 

'As{x) = 2 Tdy [Xs{y)q'Ay) + xAy)p'iy)] (47) 

Jo 

%(x) = 2 fdy {p'{y)My) + X2{y)] + [q[{y) + q'2{y)]My)} (48) 

<^ 

having made use of (|43|). The derivative with respect to x of these functions are: 

M;(a;) = 2[Xs{x)qi{x) + X,{x)p'{x)] (49) 
'A;(x) = 2{p'{x)[X,{x) + X2{x)] + [q[{x) + q',{x)]X,{x)} (50) 

In a completely analogous way one finds the functions ^As{x) and ^Ap{x) and their 
derivatives: 

^A[{x) = 3q[Xl + 2p'Ap(2Ai + X2) + Xli2q[ + q'^) (51) 
^A(x) = Sp'Xl + p'iXl + Xl + X1X2) + Xp{2Xiq[ + 2X24^ + Aig^ + Asgl) (52) 
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The formula for ^A2{x) is obtained from ( pT| ) interchanging the indices '1' and '2'. 
Observing that 

Vrn^ + n2 1 - / < > - < g.' >] r = s 

2^[Ha^ + ^f3y\ - I 2[pI- < p2 >]_ <ql>-<ql> r^s ^^"^^ 

and that the functions associated to Q|^^ are just (x) and one finds that the 
derivatives with respect to x of the saddle point equations read 

[2ri - 2y{pl- < p^ > - < qf >)]q[ + 2w[p'\p + q[\i] + 

v[3q[Xl + 2p'Ap(2Ai + A2) + Xl{2q[ + q'^)] + 2uqlq[ = (54) 



a similar equation with 1^2, and 

[2ri2 - yi2ipl- <p'>)-<ql>-< qj >)]p' 

+w[p'{Xi + X2)) + {q[ + q2)Xp\ + 

v[3XIp' +p'{Xl + Xl + A1A2) + Xp{2Xiq[ + 2X2q'2 

+Aig; + Asg'i)] + 2up^p' = 0. (55) 

Let us now study the possibility of an ultrametric solution. Consider the 'small x 
region' defined in (^3]), where gi(x) = ^2(3^) = p{x) = f{x), and suppose f'{x) 7^ 0. 
One can the differentiate repeatedly (|^) and find that 

fix) = qF{2x). (56) 

In the 'large x region', where p{x) = pd observing that Xp{x) = there, one finds 
that the second equation is automatically satisfied, while the first two equations 
reduce to 

[2r, - 2yipy < p^ > - < q^ >) + 2wA, + 3vXl + 2uql] = 0. (57) 

that is, we get two un-coupled equations for qi and q2 in this region. Again by 
repeated differentiation, we find that if 7^ then qs{x) = qp^x). Using the 
assumption of continuity we find 

qF{2x) X < xq/2 

Pd Xq/2 <x<xo ^ i gF(2x) x < xo/2 

qpix) Xq < X <Xs \ Pd Xo/2 < X < 1 

qs{l) Xs < X <1 
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The only free parameter at this level are the values qi{l) and ^72(1)- These can be 
fixed e.g. considering eq. (^71) in x = Xs which gives 



2r, + 2y 



r dx qpixf + {1-Xs)qs{lf 
Jo 



- 2wqs{l) + {3v + 2u)q,{lf = 0. (59) 



showing that is equal to the value ^^(l) corresponding to r = r^. If now one 

inserts the resulting functions in equations one finds the absurd 

{pd- <p>)i<qi> - <q2>) = (60) 

showing the inconsistency of the hypothesis of an ultrametric solution except for the 
trivial one with = 0. 
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